Developing a Knowledge Test for a Neonatal Ethics Teaching Program

Objective The innovative Neonatal-Perinatal Medicine (NPM) Ethics Teaching Program at the University of Ottawa provides NPM trainees with vital foundational knowledge required to manage ethically contentious clinical scenarios frequently encountered in practice. In this study, our aim was to develop a knowledge test to assess the impact of the NPM Ethics Teaching Program on trainees' knowledge about ethics. Study design Using an iterative four-step process, we developed a test for assessing pre- and post-training knowledge of NPM ethics. We first created a blueprint of the test, identifying its purpose, length, and format. We then weighted the learning outcomes of the NPM Ethics Teaching Program sessions to determine the number of questions that would be asked to assess to each learning outcome. Next, we populated the question bank and constructed a draft test. We obtained feedback from content experts on the draft test and piloted the draft test with former trainees from the NPM Ethics Teaching Program. Results We developed a pre- and post-knowledge test in NPM ethics consisting of 44 multiple choice questions (MCQs), each with five response options. The test takes approximately 60 minutes to complete. It took roughly 15 months to design and pilot the NPM ethics test. Conclusions This test can aid in the assessment of the amount of NPM ethics gained by trainees and contribute to the identification of areas for improvement in teaching and in the overall ethics program. Further iterations of the test will allow for additional assessment of its validity and the efficacy of the teaching program. Given the lack of structured evaluative ethics teaching programs in NPM nationally, this project will act as another step towards the introduction of our NPM Ethics Teaching Program to other Canadian NPM residencies.